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Recent physiological measurements have provided clear evidence 
about scale-free avalanche brain activity and EEG spectra, feeding 
the classical enigma of how such a chaotic system can ever learn 
or respond in a controlled and reproducible way. Models for learn- 
ing, like neural networks or perceptrons, have traditionally avoided 
strong fluctuations. Conversely, we propose that brain activity hav- 
ing features typical of systems at a critical point, represents a crucial 
ingredient for learning. We present here a study which provides novel 
insights toward the understanding of the problem. Our model is able 
to reproduce quantitatively the experimentally observed critical state 
of the brain and, at the same time, learns and remembers logical 
rules including the exclusive OR (XOR), which has posed difMculties 
to several previous attempts. We implement the model on a net- 
work with topological properties close to the functionality network 
in real brains. Learning occurs via plastic adaptation of synaptic 
strengths and exhibits universal features. We find that the learning 
performance and the average time required to learn are controlled 
by the strength of plastic adaptation, in a way independent of the 
specific task assigned to the system. Even complex rules can be 
learned provided that the plastic adaptation is sufficiently slow. 
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Spontaneous activity is an important property of the cere- 
bral cortex that can have a crucial role in information pro- 
cessing and storage. Recently it has been shown that a 




Fig. 1. One neuronal avalanche in the scale-free network. 40 neurons are con- 
nected by directed bonds (direction indicated by the arrow at one edge), representing 
the synapses. The size of each neuron is proportional to the number of in-connections, 
namely the number of dendrites. The two red neurons are the two input sites, whereas 
the black neuron is the output. Connections involved in the avalanche propagation 
are shown in red, whereas inactive connections are black. 
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novel spatio-temporal form of spontaneous activity is neuronal 
avalanches, which can involve from a few to a very large num- 
ber of neurons. These bursts of firing neurons have been first 
observed [T] [2] in organotypic cultures from coronal slices of 
rat cortex, where the size and duration of neuronal avalanches 
follow power law distributions with very stable exponents. 
The presence of a power law behaviour is the typical feature of 
a system acting in a critical state [3], where large fiuctuations 
are present and the response does not have a characteristic 
size. The same critical behaviour, namely the same power law 
exponents, has been recently measured also in vivo from su- 
perficial layers of cortex in anesthetized rats during early post- 
natal development [Ij, and awake adult rhesus monkeys [3], 
using micro-electrode array recordings. Results confirm that 
indeed spontaneous cortical activity adjusts in a critical state 
where the spatio-temporal organization of avalanches is scale 
invariant. Moreover, the investigation on the spontaneous ac- 
tivity of dissociated neurons from different networks as rat 
hippocampal neurons [6], rat embryos [7| or leech ganglia [6], 
has also confirmed the robustness of this scaling behaviour. In 
all these cases, the emergence of power law distributions has 
been interpreted in terms of self-organized criticality (SOC) 
[8]. The term SOC usually refers to a mechanism of slow en- 
ergy accumulation and fast energy redistribution driving the 
system toward a critical state, where the avalanche extensions 
and durations do not have a characteristic size. 

The understanding of the fundamental relations between 
electro-physiological activity and brain organization with re- 
spect to performing even simple tasks, is a long-standing fas- 
cinating question. A number of theoretical models [9j have 
been proposed for learning, from the simple perceptron [ID] 
to Attractor Neural Networks (ANNs) [11] of artificial two- 
state neurons [T5]. In these models the state of the "brain" 
is the snapshot of the ensemble of the individual states of all 
neurons, which explores phase space following an appropriate 
dynamics and eventually recovers memories. The ability of 
the brain to self-organize connections in an efficient way is a 
crucial ingredient in biologically plausible models. The break- 
through of Hebbian plasticity, postulating synapse strengthen- 
ing for correlated activity at the pre- and post-synaptic neuron 
and synapse weakening for decorrelated activity, triggered the 
development of algorithms for neuronal learning and memory, 
as, for instance, "reinforcement learning" [13] or error back- 
propagation _14j, leading for the first time to the XOR rule 
learning. Recent results have shown that extremal dynam- 
ics, where only the neuron with the largest input fires, and 
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uniform negative feedback are sufficient ingredients to learn 
tlie following task: to identify the right connection between 
an input and an output node |15l I16j . Similarly, low activ- 
ity probabilistic firing rules, where again a single neuron fires 
at each step of the iteration, together with a uniform nega- 
tive feedback plastic adaptation acting on time scales slower 
than the neuron firing time scale, enables learning the XOR 
rule without error back-propagation [17]. Both results sug- 
gest that the system learns by mistakes, namely depression 
rather than enhancement of synaptic strength is the crucial 
mechanism for learning. However, in both studies a single 
neuron fires at each step of the evolution, not in complete 
agreement with recent experimental discoveries. Cooperative 
effects leading to self-organization and learning are completely 
neglected in the aforementioned approaches. 

Operating at a critical level, far from an uncorrelated sub- 
critical or a too correlated supercritical regime, may opti- 
mize information management and transmission in real brains 
[181 [T| 1191 I20[ . as recently confirmed by experiments [21| . 
Moreover, a recent study of visual perceptual learning has 
evidenced that training to a specific task induces dynamic 
changes in the functional connectivity able to "sculpt" the 
spontaneous activity of the resting human brain and to act 
as a form of "system memory" [21]. It is therefore tempt- 
ing to investigate the role that critical behaviour plays in the 
most important task of neuronal networks, namely learning 
and memory. The emergence of a critical state with the same 
critical behaviour found experimentally has been recently re- 
produced by a neuronal network model based on SOC ideas 
[231 124] . The model implements several physiological proper- 
ties of real neurons: a continuous membrane potential, firing 
at threshold, synaptic plasticity and pruning. Extensive nu- 
merical studies on regular, small world and scale free networks 
have shown that indeed the system exhibits a robust critical 
behaviour. The distributions of avalanche size and duration 
scale with exponents independent of model parameters and 
in excellent agreement with experimental data (Fig. 2). More 
precisely, the distribution of avalanche sizes, measured exper- 
imentally either in terms of number of active electrodes or 
summed local field potentials in a micro-electrode array [T] [2] , 
decreases with an exponent —1.5, whereas the distribution 
of avalanche temporal durations decreases with an exponent 
close to —2.0. A critical avalanche activity has been also found 
on fully connected [53] and random networks [55]. Moreover, 
the temporal signal for electrical activity and the power spec- 
trum of the resulting time series have been compared with 
EEG data [231 124]. The spectrum exhibits a power law be- 
haviour, P{f) ~ /~°'*, with an exponent in good agreement 
with EEG medical data [27] and physiological signal spectra 
for other brain controlled activities [2S] . This model therefore 
seems to capture many of the essential ingredients of sponta- 
neous activity, as measured in cortical networks. 

Here we study the learning performance of a neuronal net- 
work acting in a critical state. The response of the system to 
external stimuli is therefore scale-free, i.e. no characteristic 
size in the number of firing neurons exists. The approach 
reproduces closely the physiological mechanisms of neuronal 
behaviour and is implemented on a plausible network having 
topological properties similar to the brain functionality net- 
work. Neuronal activity is a collective process where all neu- 
rons at threshold can fire and self-organize an efficient path 



for information transmission. Plastic adaptation is introduced 
via a non uniform negative feedback procedure with no error 
back propagation. 

The model 

We consider neurons positioned at random in a two dimen- 
sional space. Each neuron is characterized by the potential Vi. 
Connections among neurons are established by assigning to 
each neuron i a random out-going connectivity degree, koutf 
The distribution of the number of out-connections is then cho- 
sen in agreement with the experimentally measured properties 
of the functionality network [25] in human adults. Functional 
magnetic resonance imaging has indeed shown that this net- 
work has universal scale free properties, namely it exhibits a 
scaling behaviour n{kout) oc k~^f, independent of the different 
tasks performed by the patient. We adopt this distribution 
for the number of pre-synaptic terminals of each neuron, over 
the range of possible values between fc™" and fcJJS^ — 100, 
as in experimental data. Two neurons are then connected ac- 
cording to a distance dependent probability, p{r) cx e~^^^°, 
where r is their spatial distance [50] and ro a typical edge 
length. To each synaptic connection we then assign an initial 
random strength gij, where Qij Qji, and an excitatory or in- 
hibitory character, with a fraction pin of inhibitory synapses. 
An example of such a network is shown in Fig.l. 

The firing dynamics implies that, whenever at time t the 
value of the potential at a site i is above a certain thresh- 
old Vi > Umax = 6.0, approximately equal to —55ml/ for real 
neurons, the neuron sends action potentials leading to the pro- 
duction of an amount of neurotransmitter proportional to Vi. 
As a consequence, the total charge released by a neuron is pro- 
portional to the number of synaptic connections, qi oc Vikouti- 
Each connected neuron receives charge in proportion to the 
strength of the synapse gij 

nit) 9iAi) 
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where kin- is the in-degree of neuron j and the sum is ex 
tended to all out-going connections of i. In Eq.(l) it is as 
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Fig. 2. Demonstration of the critical behaviour of the neuronal network avalanche 
activity. The distribution of the sizes of the avalanches of firing neurons, Ti{S) (cir- 
cles), follows a power law behaviour with an exponent 1.5 ib 0.1 (dashed line). The 
size is measured as the number of firing neurons. The distribution of avalanche dura- 
tions, Tl{T) (squares), exhibits a power law behaviour with an exponent 2.2 di 0.2 
(dot-dashed line), followed by an exponential cutoff. Data are obtained for 40 real- 
izations of a network of 4000 neurons with pi^i — 0.05. 
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sumed that the received charge is distributed over the surface 
of the soma of the post-synaptic neuron, proportional to the 
number of in-going terminals kin^ . The plus or minus sign in 
Eq.(l) is for excitatory or inhibitory synapses, respectively. 
After firing a neuron is set to a zero resting potential and in 
a refractory state lasting tref = 1 time step, during which it 
is unable to receive or transmit any charge. We wish to stress 
that the unit time step in Eq.(l) does not correspond to a 
real time scale, it is simply the time unit for charge propaga- 
tion from one neuron to the connected ones. In real system 
this time could vary and be as large as 100 ms for longer 
firing periods. The synaptic strengths have initially a ran- 
dom value gij £ [0.5, 1.0], whereas the neuron potentials are 
uniformly distributed random numbers between iimax — 1 and 
I'max- Moreover, a small random fraction (10%) of neurons is 
chosen to be boundary sites, with a potential fixed to zero, 
playing the role of sinks for the charge. 

In order to start activity we identify input neurons at 
which the imposed signal is applied and the output neuron at 
which the response is monitored. These nodes are randomly 
placed inside the network under the condition that they are 
not boundary sites and they are mutually separated on the 
network by ka nodes, kd represents the chemical distance on 
the network and plays the role of the number of hidden layers 
in a perceptron. We test the ability of the network to learn dif- 
ferent rules: AND, OR, XOR and a random rule RAN which 
associates to all possible combinations of binary states at three 
inputs a random binary output. More precisely, the AND, OR 
and XOR rules are made of three input-output relations (we 
disregards the double zero input which is a trivial test leading 
to zero output), whereas the RAN rule with three input sites 
implies a sequence of seven input-output relations. A single 
learning step requires the application of the entire sequence 
of states at the input neurons, monitoring the state of the 
output neuron. For each rule the binary value 1 is identified 
with the output neuron firing, namely the neuron membrane 
potential at a value greater or equal to t^max at some time 
during the activity. Conversely, the binary state at the out- 



put neuron corresponds to the physiological state of a real 
neuron which has been depolarized by incoming ions but fails 
to reach the firing threshold membrane potential during the 
entire avalanche propagation. Once the input sites are stimu- 
lated, their activity may bring to threshold other neurons and 
therefore lead to avalanches of firings. We impose no restric- 
tion on the number of firing neurons in the propagation and let 
the avalanche evolve to its end according to Eq.([l]). If at the 
end of the avalanche the propagation of charge did not reach 
the output neuron, we consider that the state of the system 
was unable to respond to the given stimulus, and as a conse- 
quence to learn. We therefore increase uniformly the potential 
of all neurons by units of a small quantity, /3 = 0.01, until the 
configuration reaches a state where the output neuron is first 
perturbed. We then compare the state of the output neuron 
with the desired output. Namely we follow the evolution in 
phase space of the initial state of the system and verify if the 
non-ergodic dynamics has led to an attractor associated with 
the right answer. 

Plastic adaptation. Plastic adaptation is applied to the sys- 
tem according to a non uniform negative feedback algorithm. 
Namely, if the output neuron is in the correct state according 
to the rule, we keep the value of synaptic strengths. Con- 
versely, if the response is wrong we modify the strengths of 
those synapses involved in the information propagation by 
±a/dfe, where dk is the chemical distance of the presynaptic 
neuron from the output neuron. Here a represents the ensem- 
ble of all possible physiological factors influencing synaptic 
plasticity. The sign of the adjustment depends on the mis- 
take made by the system: If the output neuron fails to be in a 
firing state we increase the used synapses by a small additive 
quantity proportional to a. Synaptic strengths are instead 
decreased by if the expected output is not fulfilled. Once 
the strength of a synapse is below an assigned small value 
gt — 10"*, we remove it, i.e. set its strength equal to zero, 
which corresponds to the so-called pruning. This ingredient 
is very important as since decades the crucial role of selec- 
tive weakening and elimination of unneeded connections in 
adult learning has been recognized [311 132] . The synapses 
involved in the signal propagation and responsible for the 
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Fig. 3. Demonstration of the learning ability of the neuronal network. (Left) Per- 
centage of configurations learning the XOR rule as function of the number of learning 
steps for different plastic adaptation strengths o (decreasing from bottom to top). 
Data are for 400 realizations of a network with A'^ = 1000 neurons, Pin = 0.1, 
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Fig. 4. Demonstration of the scaling behaviour of learning time and success. 
(Top) Scaling of the average learning time for different rules as function of a.. 
(Bottom) Scaling of the asymptotic percentage of configurations learning different 



3 and = 5. (Right) Collapse of the curves by rescaling rules as function of Q.. Data are obtained for A;„ 



: 3, A;^ = 5 and pin = 0.1. 



the number of learning steps by the characteristic learning time r = 1/a and the 
percentage of success by a~ 



Both quantities follow a power law with an exponent independent of the rule and the 
percentage of inhibitory synapses. 
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wrong answer, are therefore not adapted uniformly but in- 
versely proportional to the chemical distance from the output 
site. Namely, synapses directly connected to the output neu- 
ron receive the strongest adaptation ±a. This adaptation rule 
intends to mimic the feedback to the wrong answer triggered 
locally at the output site and propagating backward towards 
the input sites. This could be the case, for instance, of some 
hormones strongly interfering with learning and memory, as 
dopamine suppressing LTD [M] or adrenal hormones enhanc- 
ing LTD [35] . Moreover a new class of messenger molecules as 
nitric oxide has been found to have an important role in plas- 
tic adaptation [36]. For all these agents, released at the output 
neuron, the concentration is reduced with the distance from 
the origin. In our neuronal network simulation this non uni- 
form adaptation has a crucial role since it prevents, in case 
of successive wrong positive answers, synapses directly con- 
nected to the input sites to decrease excessively, hindering 
any further signal transmission. This plastic adaptation is a 
non-Hebbian form of plasticity and can be interpreted as a 
subtractive form of synaptic scaling [SB], where synapses are 
changed by an amount independent of their strength. The 
procedure mimics the performance of a good critic who does 
not tell the system which neurons should have fired or not. 
However it tells more than just "right" or "wrong", it ex- 
presses an evaluation on the type of error. Finally, we wish to 
stress that this model naturally sets the system in a critical 
state and therefore the study of the response of the system in 
a subcritical or supercritical state requires the introduction of 
additional parameters. We can however suppose that in both 
cases learning becomes a more difficult task. For instance, 
in a subcritical state, being the size of neuronal avalanches 
smaller, it would be more complex to generate a firing state 
in the output site. Conversely, in a supercritical state it would 
be more difficult to generate a non-firing state in the output 
site. 



Results and Discussion 

We analyse the ability of the system to learn the different 
rules. Fig. 3 shows the fraction of configurations learning the 
XOR rule versus the number of learning steps for different val- 
ues of the plastic adaptation strength a. We notice that the 
larger the value of a the sooner the system starts to learn the 
rule, however the final percentage of learning configurations 
is lower. The final rate of success increases as the strength of 
plastic adaptation decreases. This result is due to the highly 
non linear dynamics of the model, where firing activity is an 
all or none event controlled by the threshold. Very slow plastic 
adaptation allows then to tune finely the role of the neurons 
involved in the propagation and eventually recover the right 
answer. Moreover, very slow plastic adaptation also makes 
the system more stable with respect to noise, since too strong 
synaptic changes may perturb excessively the evolution ham- 
pering the recovery of the right answer. The dependence of 
the learning success on the plasticity strength is found consis- 
tently for different values of the parameters kd, kmin and pin, 
where a higher percentage of success is observed in systems 
with no inhibitory synapses. Moreover, the dependence on the 
plastic adaptation a is a common feature of all tested rules. 
Data indicate that the easiest rule to learn is OR, where a 
100% percentage of success can be obtained. AND and XOR 



present similar difficulties and lead both to a percentage of 
final success around 80%, whereas the most difficult rule to 
learn is the RAN rule with three inputs where only 50% of 
final success is obtained. This different performance is mainly 
due to the higher number of inputs, since the system has to 
organized a more complex path of connections leading to the 
output site. 

The most striking result is that all rules give a higher 
percentage of success for weaker plastic adaptation. Indeed 
this result is in agreement with recent experimental findings 
on visual perceptual learning, where better performances are 
measured when minimal changes in the functional network oc- 
cur as a result of learning [22]. We characterize the learning 
ability of a system for different rules by the average learning 
time, i.e. the average number of times a rule must be applied 
to obtain the right answer, and the asymptotic percentage of 
learning configurations. This is determined as the percentage 
of learning configurations at the end of the teaching routine, 
namely after 10® applications of the rule. Fig. 4 shows that 
the average learning time scales as r cx l/a for all rules and 
independently of parameter values. Since some configurations 
never learn and do not contribute to the average learning time, 
we also evaluate the median learning time which exhibits the 
same scaling behaviour as the average learning time. The 
asymptotic percentage of success increases by decreasing a as 
a very slow power law, « a''^'"^ . Since this quantity has a 
finite upper bound equal to unity, this scaling suggests that in 
a finite, even if very long, time any configuration could learn 
the rule by applying an extremely slow plastic adaptation. It 
is interesting to notice that a larger fraction of systems with 
no inhibitory synapses finds the right answer and the aver- 
age learning time for these systems is slightly shorter. We 
understand this result by considering that for only excita- 
tory synapses the system more easily selects a path of strong 
enough synapses connecting inputs and output sites and giv- 
ing the right answer. Conversely, the presence of inhibitory 
synapses may lead to frustration in the system as not all lo- 
cal interactions contribute in the optimal way to provide the 
right answer and the system has to find alternative paths. 
We check this scaling behaviour by appropriately rescaling 
the axes in Fig. 3. The curves corresponding to different a 
values indeed all collapse onto a unique scaling function. Sim- 
ilar collapse is observed for the OR, AND and RAN rules and 
for different parameters kd, kmin and pi„. In fact, two differ- 
ent cases of distributions of inhibitory synapses, one in which 
they are chosen randomly among all synapses, the other where 
certain randomly chosen neurons have all outgoing synapses 
inhibitory, provide equivalent results. The learning dynam- 
ics shows therefore universal properties, independent of the 
details of the system or the specific task assigned. 

The learning behaviour is sensitive to the number of neu- 
rons involved in the propagation of the signal, and therefore 
depends on the distance between input and output neurons 
and the level of connectivity in the system. We then inves- 
tigate the effect of the parameters kd and kmin on the per- 
formance of the system. Fig. 5 shows the percentage of con- 
figurations learning the XOR rule for different minimum val- 
ues of the neuron out degree. Systems with larger kmin have 
a larger average number of synapses per neuron, producing 
a more branched network. The presence of several alterna- 
tive paths facilitates information transmission from the in- 
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puts to the output site. However, the participation of more 
branched synaptic paths in the learning process may delay 
the time the system first gives the right answer. As expected 
the performance of the system improves as the minimum out- 
connectivity degree increases, with the asymptotic percentage 
of success scaling as ~ . The dependence of the learning 
performance on the level of connectivity is confirmed by the 
analysis of systems with different number of neurons A'^, the 
same out-degree distribution and the same set of parameters. 
We verify that larger systems exhibit better performances. In 
larger systems, in fact, the number of hubs, i.e. highly con- 
nected neurons, increases improving the overall level of con- 
nectivity. Indeed, the existence of complex patterns of activa- 
tion has been recently recognized as very important in linking 
together large scale networks in visual perceptual learning|22j . 

On the other hand, also the chemical distance between the 
input and output sites has a very important role, as the num- 
ber of hidden layers in a perceptron. Indeed, as kd becomes 
larger (Fig. 5), the length of each branch in a path involved in 
the learning process increases. As a consequence, the system 
needs a higher number of tests to first give the right answer 
and a lower fraction of configurations learns the rule after the 
same number of steps. The percentage of learning configura- 
tions after 10^ applications is found, as expected, to decrease 
as ~ '^j"'"^ and similar behaviour is detected for the OR, AND 
and RAN rules. 

Learning stability and Memory. The existence of systems that 
are unable to learn, even after many learning steps, raises in- 
triguing questions about the learning dynamics. We question 
what happens when a second chance is given to the configu- 
rations failing the right answer. We then restart the learning 
routine after imposing a small change in the initial configura- 
tion of voltages. This small perturbation leads to about 25% 
more configurations learning the rule. The initial state of the 
system can therefore influence the ability to learn, especially 
for complex rules as XOR or RAN. On the other hand, the 
analysis of the out-degree distribution in configurations which 
did and did not give the right answer indicates that "dumb" 
configurations tend to have less highly connected nodes than 
the '"smart" ones. Namely, giving repeatedly wrong positive 
answers leads to pruning of several synapses. This affects in 
particular the highly connected neurons, which have a crucial 
role in identifying the right synaptic learning path. Finally we 
test the ability of the configurations that do learn to remem- 
ber the right answer once the initial configuration is changed. 
The memory performance of the system is expected to depend 
on the intensity of the variation imposed, namely on the ex- 
tension of the basin of the attraction of states leading to the 
right answer. The system is able to recover the right answer 
in more than 50% of the configurations if a very small per- 
turbation (of the order of 10^'^) is applied to all neurons or 
else a larger one (of the order of 10"'^) to 10% of neurons. 
The system has a different memory ability depending on the 
rule: almost all configurations remember OR, whereas typi- 
cally 80% remember AND and at most 70% the XOR rule. 



Conclusions 

In conclusion, we investigate the learning ability of a model 
able to reproduce the critical avalanche activity as observed 
for spontaneous activity in in vitro and m vivo cortical net- 
works. The ingredients of the model are close to most func- 
tional and topological properties of real neuronal networks. 
The implemented learning dynamics is a cooperative mecha- 
nism where all neurons contribute to select the right answer 
and negative feedback is provided in a non-uniform way. De- 
spite the complexity of the model and the high number of 
degrees of freedom involved at each step of the iteration, the 
system can learn successfully even complex rules as XOR or 
a random rule with three inputs. In fact, since the system 
acts in a critical state, the response to a given input can be 
highly flexible, adapting more easily to different rules. The 
analysis of the dependence of the performance of the sys- 
tem on the average connectivity confirms that learning is a 
truly collective process, where a high number of neurons may 
be involved and the system learns more efficiently if more 
branched paths are possible. The role of the plastic adap- 
tation strength, considered as a constant parameter in most 
studies, provides a striking new result: The neuronal network 
has a "universal" learning dynamics, even complex rules can 
be learned provided that the plastic adaptation is sufficiently 
slow. This important requirement for plastic adaptation is 
confirmed by recent experimental results 22 showing that the 
learning performance, in humans trained to a specific visual 
task, improves when minimal changes occur in the function- 
ality network. Stronger modifications of the network do not 
necessarily lead to better results. 
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Fig. 5. Demonstration of the dependence of the learning performance on the min- 
imum connectivity degree and the chemical distance between input and output sites. 
(Left) Percentage of configurations learning the XOR rule as function of the num- 
ber of learning steps, for a = 0.005 in systems with = 5 and different values 
of 

^min (increasing from bottom to top). (Right) Percentage of configurations 
learning the XOR rule as function of the number of learning steps, for a = 0.005 in 
systems with kmin = 3 and different values of kfi (decreasing from bottom to top). 
Data are for 400 realizations of a network with = 1000 neurons, = 0.1. 
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